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Abstract 

This  paper  describes  a representational  mechanism  for  constructing 
3-dimensional  large  sca'a  spatial  organizations  suitable  for  applications 
in  areas  such  as  cartography  and  land  use  studies,  photo  interpretation 
for  rcconnaisancc  and  surveillance,  and  geological  modeling  for 
resource  analysis.  It  focuses  on  the  representation  and  utilization  of 
map  information  as  a knowledge  source  for  photo-interpretation,  in 
particular,  the  description  of  a highly  detailed,  large  scale  geographic 
area:  Washington,  D.C..  Methods  of  data  acquisition,  query 

specification  and  geometric  operations  on  map  data  are  discussed. 
These  ideas  have  been  implemented  into  a working  map  database 
system,  CONCEP1  MAP,  as  a component  of  MAPS:  (Map  Assisted 
Photo-interpretation  System),  our  ongoing  research  in  interactive 
photo-interpretation  work  stations. 
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1.  Introduction 

Consider  the  problem  of  building  a system  capable  of  generating 
answers  to  representative  map  database  queries  such  as: 

• "How  many  bridges  cross  the  Potomac  River  between 
Virginia  and  the  District  of  Columbia." 

• "Display  images  of  National  Airport  before  1976," 


i "What  is  the  closest  building  to  this  geographic  point." 
> "Where  is  this  geographic  point." 


* '111  is  research  was  sponsnred  by  tire  Defense  Advanced  Research  Projects  Agency 
(DOD).  ARPA  Order  No.  3597.  and  monitored  hy  the  Air  Porcc  Avionics  laboratory 
under  Contract  I-336I5-78-C-I551.  The  views  and  conclusions  in  this  document  arc  those 
of  the  author  and  should  ool  he  interpreted  is  representing  the  official  policies,  either 
expressed  or  implied,  of  the  Defense  Advanced  Research  Projects  Agency  or  the  U.S. 
Government. 


Possible  .'olutions  to  the  query  problem  range  from  pre-computation 
and  storage  of  potentially  huge  numbers  of  spatial  relationships,  to 
dynamic  compulation  involving  both  costly  search  . nd  complex 
geometric  analysis.  We  favor  dynamic  (on  demand)  ( -mpuiation  of 
geometric  relationships,  constrained  by  user  defined  structuring  of  map 
features  and  utilizing  natural  spatial  decomposition.  However, 
whatever  the  query  resolution  mechanism,  a representation  lor  the  rich 
variety  of  man-made  and  natural  features  must  underlie  any  such 
system.  Further,  in  order  to  be  relevcnt  to  the  needs  of  the  photo- 
interpreter, titc  results  of  the  query  should  be  portrayed  in  terms  of  the 
display  of  digital  imagery,  at  the  appropriate  image  resolution.  While 
many  queries  can  be  answered  as  purely  "factual"  responses,  (ic.  8 
bridges  cross  the  Potomac  between  Virgina  and  District  af  Columbia ),  in 
our  system  we  arc  able  to  quickly  show  the  user  the  location,  relative 
position,  and  scene  context  directly  through  our  aerial  imagery,  as  well 
as  providing  the  necessary  textual  and  descriptive  information.  This  is  a 
key  point  of  departure  from  many  "geographical"  or  "spatial 
information  systems"  [3, 4,  5]in  that  they  simply  provide  tabular  lookup 
for  geographic  "facts”,  and  vector-based  display  of  digitized  map  data. 

Our  map  database  consists  of  a collection  of  concepts  each  describing 
large  spatial  features  such  as  political  areas  (stales,  counties,  low  ■is...), 
business  and  residential  areas,  parks  and  natural  features  ( rivers, 
streams,  lakes...).  The  same  concept  representation  is  used  to 
hierarchically  describe  man-made  features  airports,  power  stations, 
universities  industrial  sites....  A window-oriented  raster  image  display 
facility,  IWOWSK  [9],  is  the  man-machine  interface  for  the  concept 
map  database  and  is  used  to  create,  edit,  and  display  concept  features 
superimposed  on  2D  aerial  photography,  and  to  generate  arbitrary  3D 
scene  views. 

"’we  arc  not  concerned  with  the  natural  language  issues  of  such  queries,  our  query 
inlcrlacc  is  based  oil  a combination  of  query  template  oialching.  geometric  spccificatioo. 
and  interactive  coordinate  input  through  raster  image  display. 
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In  this  paper  we  will  explore  many  of  the  issues  raised  in  map  feature 
representation  and  query  resolution,  and  describe  the  current 
implementation  of  the  CONCLI'l  MAE  database  of  lire  Washington 
D.C  area.  In  the  following  section  we  cite  an  overview  of  the  MAI  S 
system  components. 

2.  MAPS  Components 

M M’S  represents  ongoing  research  in  tire  areas  of  interactive  aids  for 
photo-interpretation,  image/map  spatial  databases,  and  image 
understanding.  Various  components  of  the  system  have  been  described 
in  [7)  [integration  of  terrain  imager}',  and  map  database:,],  [8]  [system 
goals  and  design],  and  [9]  [I1ROWSI-  . mdon-oriented  display  system]. 
For  completeness  we  will  highlight  the  major  capabilities  of  the  MAPS 
components,  but  the  reader  is  referred  to  the  above  for  more  detail. 

2.1 .  Image  Database 

We  have  been  working  with  an  online  database  of  approximately  40 
aerial  mapping  photographs  providing  spatial  and  temporal  overlap, 
centered  over  the  Washington  D.C.  area.  Haeh  photograph  has  been 
digitized  with  a 100  micron  aperaturc  to  approximately 
2200x2200x8bits/pixcl.  Original  photography  scales  range  from 
1:12000  to  1:36000,  and  we  have  recently  acquired  and  begun  to 
integrate  20  new  digitized  images  at  1:60000  scale  into  tire  database. 
Associated  with  each  image  arc  several  files,  among  which  are. 

.scene  description  file.  Contains  scene  and  image 
formation  information  such  as  camera  type,  aircraft  platform 
data,  geodetic  corner  points,  digitization  data,  and  source  of 
data. 

# fiU*  Contains  ima«ic/map 

correspond  zc  points  for  known  ground  control  points. 

This  file  is  interactively  generated  and  modified  by  the 
image-to-map  correspondence  component. 

* coefficients  file.  Contains  image-to-map  camera 

calibrati  in  coefficients,  error  function  description,  and 
reference  to  the  associated  correspondence  file. 


2.2.  DLMS  Database 

We  have  adapted  and  restructured  a geodetic  based  polygon  feature 
database  (Dl.MS  Level  1)  [1]  and  a digital  terrain  elevation  database 
(USGS  DIED)  provided  by  the  Defense  Mapping  Agency,  to  allow  for 
efficient  feature  access  based  on  geodetic  coodinates  or  feature 
attributes.  This  database  (D1.MS3D)  provides  a fairly  coarse 
description  of  major  natural  and  cultural  terrain  features  and  is  used  as 
a background  basis  for  3D  display  of  urban  scene  simulations. 


2.3.  BROWSE  Window  Oriented  Display 

BROWSE  is  a window-oriented  display  manager  which  supports 
raster  image  display,  overlay  of  graphical  data  such  as  map  descriptions 
and  image  processing  segmentations,  and  the  spceiPcalion  and 
generation  of  3D  shaded  surface  models.  Digitized  imagery  from  black 
and  white  and  color  aerial  mapping  photographs  is  displayed  by 
BROWSE  at  multiple  levels  of  resolution  and  allows  for  dynamic 
positioning,  zooming,  expansion  or  shrinking  of  the  image  window. 
Map  data  represented  as  vectors  and  polygons  can  be  superimposed  on 
the  imagery  through  image-to-map  registration.  Access  to  collateral 
map  databases  and  terrain  models  may  be  accomplished  using  the 
BROWSE  graphical  interface.  E'inally,  the  window  representation  gives 
a convenient  communication  mechanism  for  passing  image  fragments 
to  image  interpretation  programs,  which  generally  run  as  separate 
processes.  The  results  of  such  processing  can  be  returned  to  BROWSE 
for  further  processing  by  the  user. 

BROWSE  is  used  regularly  as  a front-end  for  image  processing  and 
database  programs  in  die  MAES  system  and  also  as  a general  purpose 
image  display  facE.ty. 

2.4.  Landmark  Database 

A landmark  database  (LANDMARK)  containing  approximately  180 
ground  control  points  over  die  Washington  D.C.  area  has  been  created. 
Each  landmark  entry  consists  of  the  geodetic  coordinate  latitude, 
longitude.  clevatiun>.  a textual  description  of  die  landmark,  and  a 
representative  image  fragment  which  defines  die  ground  position  Tor 
die  interactive  over.  Entries  in  the  landmark  d..uihaso  may  be  selected 
hy  name,  geodetic  location,  or  by  interactive  menu  selection  from  a raster 
display  of  image  fragments. 

2.5.  image-to-Map  Correspondence 

An  interactive  image-to-map  correspondence  component  (CORRES) 
uses  the  landmark  database,  die  image  database,  and  BROWSE 
window  display  primitives  to  allow  a use-  to  graphically  select  a 
landmark  and  indicate  the  corresponding  point  in  the  new  image.  After 
the  specification  of  the  first  corresponding  point,  CORRES  can 
generate  an  inidal  guess  of  the  map  coverage  using  flight  line,  image 
scale  and  digitization  data  from  the  scene  description  file  stored  in  the 
image  database.  Landmark  candidates  arc  graphically  superimposed  on 
the  new  image,  allowing  novice  users  to  select  landmarks  with  litdc 
domain  knowledge.  Since  each  landmark  has  an  associated  image 
fragment  we  could  extend  these  interactive  techniques  to  a more  semi- 
automatic system  which  would  perform  image  fragment  matching  to 
calculate  a set  ol  local  correspondence  puims  wiflmt  C.v.  femdn.ait  aea, 
possibly  resulting  in  a more  robust  match. 
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2.6  Hand  Segmentation 

An  interactive  human  segmentation  system  (SEGMENT)  was  one  of 
the  earliest  tools  developed  for  tlic  MAI’S  system.  It  allows  the  tiser  to 
specify  tlic  position  and  shape  of  a map  feature,  as  well  as  capabilities  to 
edit  and  display  segmentations  in  multiple  levels  of  detail. 
Segmentation  tiles  arc  used  as  intermediate  representations  for  tlic  map 
database,  facilities  to  convert  image  based  descriptions  into  map  based 
descriptions  or  to  project  map  based  descriptions  onto  new  imagery  are 
provided. 

2.7.  Machine  Segmentation 

An  experimental  coarse-fine  segmentation  system  (MACIIINESEG) 
using  region-growing  and  edge  profile  analysis  has  been  successfully 
used  to  extract  map  features  such  as  buildings,  roads,  and  bridges  from 
our  aerial  imagery.  MACIIINESEG  uses  a coarse  hand  or  map 
segmentation  to  specify  the  area  within  which  a detailed  machine 
segmentation  should  he  performed.  The  user  can  accept,  reject  or  edit 
the  segmentation  descriptions  as  they  arc  generated. 

2.8.  Feature  Mensuration 

A simple  image  based  feature  measurement  system 
(PHOTOGRAM)  is  currently  under  development  to  provide  accurate 
map  feature  ground  measurement  data  for  integration  with  the  map 
database.  This  system  uses  the  BROWSE  window  display  system  and 
the  image  database  to  calculate  linear  distance,  rectangular  area, 
polygon  area,  and  radial  distance. 

3.  Map  Database 

The  concept  map  database  component  of  MAPS  is  central  to 
providing  access  to  imagery,  guiding  photo  interpretation,  and 
processing  queries  about  manmade  and  natural  features.  Through  the 
image-to-map  correspondence  process,  map  knowledge  can  be  applied 
to  any  image,  and  the  spatial  relationships  of  sets  of  imagery  can.  be 
established.  The  concept  map  provides  a framework  within  which 
individual  map  features  can  be  associated  with  high-level  semantic  map 
descriptions.  Concept  maps  capture  the  spatial  arrangement  in  urban 
areas  of  neighborhoods,  political,  and  geographical  boundaries.  For 
example,  terms  such  as  "Northwest  Washington",  "Georgetown", 
"Foggy  Bottom",  "Alexandria,  Virginia"  arc  often  used  to  describe 
general  areas  within  and  around  Washington  D.C.  They  provide  an 
important  mechanism  for  symbolic  access  into  an  image  database,  c.g. 
"display  images  of  Georgetown  later  than  1976".  However,  depicting 
precise  boundaries  of  conceptual  features  from  aerial  imagery  is  a 
difficult  problem.  In  many  eases  boundaries  arc  ill-defined  and  highly 
dependent  on  the  user  s own  spatial  model,  wmen  oitcn  corresponds  to 


a hierarchy  of  Inch  of  detail  among  map  features.  I lie 
CONCI  TIMM’ database  allows  users  the  flexibility  of  describing  this 
hierarchy  in  terms  of  a geodetic  coordinate  system,  independent  of  any 
particular  image,  while  using  the  imagery  directly  as  the  medium  of 

input. 

Concept  map  features  can  be  directly  used  to  partition  large  scale 
spatial  areas  hased  on  natural  spatial  relationships  such  as  containment, 
subsumed  by  and  intersection.  I sing  these  relationships,  which  often 
arise  in  database  queries,  rather  than  artificial  cellular  or  raster 
organizations  traditionally  used  for  spatial  decomposition  appears  to 
better  model  the  performance  of  human  map  interpreters. 
Additionally,  as  we  will  describe  in  Section  6,  many  queries  into  the 
map  database  can  he  resolved  at  the  symbolic  level  through 
manipulation  of  spatial  relationships  without  resorting  to  geometric 
computations.  In  the  following  section  we  will  describe  the 
representation  and  organization  of  concepts  in  the  map  database. 

4.  Concept  Map  Representation 

Each  entity  in  the  concept  map  is  represented  by  a concept  schema. 
The  schema  is  given  a unique  ID  by  the  database  and  the  user  specifies 
a 'symbolic'  print  name  for  the  concept.  Each  concept  may  have  one  or 
more  iqJc  schema  associated  with  it.  The  practical  efTcc.  of  multiple 
roles  is  to  allow  for  differing  views  of  die  same  geographic  concept,  ic.. 
"northwest  Washington"  has  a roles  of  residential  area,  as  well  as 
political  while  sharing  the  same  3D  map  descrip'  on.  A principle  role  is 
assigned  by  the  user,  indicating  a preferred  view,  or  a role  whose  3D 
map  description  defines  the  concepts’  spatial  extent.  Figure  1 gives  the 
organization  of  the  concept  schema,  lhc  CONC1-.F1  MAP  database  is 
composed  of  lists  of  concept  schema,  with  access  functions  based  on 
symbolic  name,  geodetic  coordinate  and  spatial  rclatit  nships. 

4.1.  Role  Schema 

The  role  schema  depicted  in  Figure  2 contains  the  definition  of  a role 
name  and  further  specification  by  subrole  name,  a description  of  role 
class  (ie„  buildings  may  be  government,  residential,  commercial,  etc.). 
The  role  type  attribute  addresses  the  issue  of  whether  the  role  is 
physically  realized  in  the  scene  (image),  or  is  a conceptual  feature  such 
as  cultural  (neighborhood),  political,  or  geographic  boundaries. 
Further,  role  type  allows  the  user  to  define  a reJg  schema  as  a collection 
of  aggregrate  physical  or  conceptual  features.  For  example,  the  concept 
"district  of  Columbia"  has  role  type  aggregrale-conceptual,  with 
aggregrate  roles,  “northwest  Washington",  “nuriheast  Washington”, 
"southwest  Washington",  and  "southeast  Washington".  This  mechanism 
attuws  flic  databas.  . rlldtfy  - .press*  torture 
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ROLE  SCHEMA 


CONCLPT  SCHEMA 


Concept  ID 
Concept  Mane 
Role  Count 
Principle  Role 
Role  List 
Role  ID  1 

Role  ID  n 


<assigned  by  database,  unique  tD> 

<user  defined  'symbolic  nane'  string> 
<number  of  roles  defined  for  concept? 
<default  role  interpretation  for  concept? 
<•  1 1 s t of  role  id's? 


Role  ID 
hole  Name 
Subrole  Name 
Role  Class 
Role  Type 
Role  Derivation 
Role  Mark 
Role  3D  ID 
Role  Defn  ID 
Aggregrate  List 
Role  ID  1 | 

: I 

Role  ID  n I 


<assiyned  by  the  databases 

sma  jor  role  (bridge,  airport,  umvers  ity . . . )> 

<f ur ther  specification  of  roles 
<generic  class  (industrial,  govenment . . . )s 
<pliysical  or  conceptual,  single  or  collections 
<meLhod  by  winch  role  was  added  to  databases 
unternal  use  during  database  querys 
<assigned  by  database  for  1 a t/ 1 on/e  1 e va t ion  dest 
<ass igned  by  database  for  role  attribute  specif 
<list  of  user-defined  component  roless 


Figure  1:  Concept  Schema 

composed  of  other  concept  roles,  andean  be  used  in  query  resolution  as 
a form  of  inberilencc.  That  is  to  say,  attributes  such  as  population  of 
“district  of  Columbia"  can  be  calculated  by  examining  die  attribute 
values  of  its  aggregrate  roles.  Similar  operations  based  on  geometric 
calculation  of  spatial  containment  provide  a more  llexihlc  mechanism 
for  such  analysis. 

Other  role  schema  attributes  tire  role  derivation  and  role  mark.  Role 
derivation  accounts  for  the  method  by  which  the  role  and  31)  II) 
descriptor  were  added  to  the  concept  map  database.  Role  mark  is  used 
to  mark  nodes  during  query  search,  and  during  creation,  deletion  and 
modification.  Ilaeh  role  schema  contains  a unique  31)  II)  which  defines 
a set  of<lamude/luiigiimlc/cle\ation>  triples  which  position  the  role  in 
map  space.  The  31 ) description  allows  lor  point,  line,  and  polygon 
features  as  primitives,  and  the  aggregation  of  primitives  inio  more 
complex  topologies,  ic.  regions  with  holes,  discominous  lines,  and 
point  lists,  figure  3 gives  a list  of  the  current  role  schema  attribute 
values. 


Figure  2:  Role  Schema 

4.2.  Further  Role  Specification 

Associated  with  each  rule  name  there  is  a dctai.cd  role  property 
template  which  further  specifics  role  context  dependent  attributes  or  the 
stibrulc.  For  instance,  for  the  role  natnc  residential  area  the  subroles 
may  be  single  family,  mixed  housing,  apartment  complex,  rural.  The 
role  property  template  contains  slots  for  population,  housing  density, 
roof  and  tree  cover  as  a percentage  of  area,  and  other  attributes.  In  the 
absence  of  specification  by  the  user,  default  attribute  values  are  used, 
within  die  context  of  the  subrolc.  Users  may  dynamically  create  new 
snbrolcs,  and  use  existing  or  newly  specified  attribute  defaults.  The 
addition  of  a new  role  name  and  associated  role  property  template 
requires  intervention  by  the  system  maintaincr.  figure  4 gives  a list  of 
the  current  subrole  attribute  values  for  the  roles  buildings,  bridges,  and 
airport. 

figure  5 goes  a partial  list  of  the  current  concent  symbolic  names 
and  associated  ride  ids.  As  of  this  writing  there  are  1 10  concepts  with 
183  Riles  in  the  CONCfPTMAP  database.  We  plan  to  incrementally 
increase  the  complexity  of  the  database  both  in  terms  of  numberof  map 
features  represented  and  the  richness  of  the  underlying  representation. 


ROLES: 
unknown 
bridge 
reservoir 
residential  area 
RDLE-TYPES: 
unknown 

aggregra t e- concept 
RDLE-CLASS: 
unknown 
res idential 
RDLE-DERI VATIDN : 
unknown 

terminal- interacti 
RDLE-MARK : 
none 

new-eoncept 
modify-role 


16  role  names: 
university 
political 
sports  complex 
geographic 

5 role  v,pes: 
phys ical 

al 

6 role  classes 
indus  trial 
governmen  t 

5 derivation  c 
hand-segmentation 
n 

9 mark  classes: 
geo-query 
new-role 
new-3D 


building 

road 

airport 

industrial  area 
aggregrate -phys ical 


transportation 
cultural  feature 
asses : 

1 andmark -description 


template-query 
modify-concept 
n:od  ify-3D 


water 

park 

hospital  complex 
parking  lot 

conceptual 


natural  feature 
commerc i a 1 

machine-segmentation 


Figure  3:  Role  Schema  Attribute  Values 
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ROLE  building  State 

i information  for 

role  ( 1 ) 

Sub  role  file:  /usriO/vdata/maps/bui Id ing.  dyn 

unknown 

performing  arts  complex 

museum 

off  ice  building 

railroad  station 

dormi tory 

government  building 

administration 

memor i a 1 

concert  hall 

terminal  building 

10  file  status:  KEY:  'BOLD' 

Min:  1 Ma.\ : 38 

Active 

: 32  Next:  39 

ROLE  bridge  State 

information  for 

role  ( 2 ) : 

Sub  role  file:  /usriO/vdata/maps/bridge.dyn 

unknown 

railroad 

pedestrian 

automobile 

ID  file  status : KEY:  BROG 

Min:  1 Max;  B 

Active: 

8 Next:  9 

ROLE:  airport  State 

information  for 

role  ( 5 ) : 

Sub  role  file:  /usr iO/vdata/maps/airport. dyn 

unk  nown 

commercial 

military 

operations  building 

termina 1 

runway 

hangars 

navigational  beacons 

1U  file  status:  KEY.  'AIRP' 

Min:  1 Max:  10 

Active: 

10  Next:  11 

Figure  4:  Subrolc  Attrihute  Values:  building,  road,  airport 


5.  Some  Examples 

In  this  section  we  will  briefly  describe  three  sample  concept  map 
entries  taken  from  the  Washington  D.C.  concept  map  database.  These 
examples  illustrate  the  flexibility  of  the  concept  map  representation  and 
were  created  In  interactive  query  to  the  database. 


5.1 . Map  Feature  Concept 

Figure  6 shows  a typical  map  feature  entry  in  die  CONCKPTMAP 
database.  ITiis  entry.  ‘Washington  circle’,  (a  traffic  circle  in  die  Foggy 
bottom  area)  was  created  during  an  interactive  terminal  session.  Figure 
7 gives  die  (latitude,  longitude,  elevation > description  for  the 
Washington  circle’  concept  map  entry  which  is  defined  in  die  role 
schema  as  ’D3ID3’  and  wascrcaicd  by  interactive  specification  of  image 


CONCEPT  1 
CONCEPT 2 
C0NCEPT3 
C0NCEPT4 
C0NCEPT5 
C0NCSPT6 
C0NCEPT7 
CONCEPTB 
C0NCEPT9 
CONCEPT  1 D 
CONCEPTU 
CDNCEPT 1 2 
CONCEPT 1 3 
CONCEPT  1 4 
C0NCEPT15 
CONCEPT  1 6 
CONCEPT 1 7 
CONCEPT  1 8 
CONCEPT 1 9 
C0NCEPT2D 
C0NCEPT2 1 
C0NCEPT22 


POI.  1 1 
POL  1 2 
RESV1 
POL  1 3 
POL  1 4 


BULD8 


tidal  basin  WATER  1 
district  of  Columbia  POI.  1 1 RESI2 
northwest  Washington  P0LI2  RESI1 
macmillian  reservoir 
southwest  Washington 
northeast  Washington 
Virginia  P0LI5 
maryland  P0LI6 
Kennedy  center  BULD1 
ellipse  PARK  1 
Washington  circle  R0AD1 
state  department  BULD2 
executive  office  building  BULD3 
white  house  BULD4 
treasury  huilding  BULD5 
department  of  commerce  BULD6 
arlington  memorial  bridge  BRDG1 
rfk  stadium  SP0RT1 
museum  of  history  and  technology 
key  bridge  BRDG2 
kutz  bridge  BRDG3 
george  mason  bridge  BRDG4  o- 


points  in  database  image  ’dc38617\  Using  the  image-to-map 
correspondence  for  dc38617‘,  geodetic  coordinates  are  calculated. 
Ground  elevations  are  calculated  by  lookup  and  interpolation  from  our 
digital  terrain  elevation  database  [1J.  I he  original  image  coordinates 
are  saved  for  possible  refinement,  and  are  accessable  through  the 
’D3 1 IT  attribute. 


Figure  8 gives  the  conccptmap  entry  for  21)  feature  description  for 
Washington  circle’.  Simple  shape  features  such  as  centroid , area , 
perimeter,  and  fourier  coefficients  are  calculated  from  the  role  schema 
1)311)  in  map  coordinate  space  and  are  used  by  our  MACFIINSFG 
system  in  conjunction  with  the  D31D  to  specify  location  and  shape  of 
map  features. 
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national  airport  AIRPl  BUL017  AIRP3  AIRP4 

u.s.  Capitol  PARKB  BULD1B 
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Washington  navy  yard  1NDU2 

boiling  air  force  base  AIRP5 
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national  academy  of  sciences  BULD2D 
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Figure  5:  Washington  D.C.  CONCHPTS  and  Hole  IDs  [partial  list] 
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Concept.  'Washington  circle’ 

Concept  id:  ’CONCEPT11’  1 roles  (principle  role:  0) 

[0]  Washington  circle 

Role  ID:  ’ RDAD1  ’ Role  Defn  ID:  ” 

Role  name:  ’road'  subrole:  'traffic  circle* 

Role  class:  ’transportation’  type:  'physical* 
Role  deriv:  * terminal - inter  act  ion ' 

Rule  mark:  ’none' 

3D  Role  ID:  ’D3ID3'  3D  Role  poir  90 


Figure  ft  Washington  Circle 


5.2.  Landmark  Concept 

Figure  10  lists  the  concept  map  entry  for  George  mason  bridge’,  The 
role  schema  attribute  role  derivation  sped  Tics  this  concept  as  being  a 
’landmark-description’.  When  listing  this  role  entry  the  concept  schema 
attribute  concept  name  is  used  to  index  into  the  landmark  database 
(LANDMARK) [8]  to  produce  the  textual  description  which  defi-'s 
the  landmark  entry.  This  allows  entries  in  our  landmark  database  to  be 
directly  accessible  through  the  concept  map. 
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Figure  7:  Washington  Circle  3D  Database  Entry 
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Figure  8:  Washington  Circle  2D  Shape  Descriptors 

The  photograph  in  Figure  9 was  created  by  CONCEPTMAP  as  a 
result  of  the  query  " Display  all  images  containing  ' Washington  circle 
Using  the  BROWSE  subroutine  package  as  primitives,  a display  frame 
is  created  composed  of  windowed  image  fragments  centered  around  the 
map  fcaiurc.  Once  displayed,  any  of  the  windows  can  be  manipulated 
using  commands  within  CONCEFrMAP.  Thus,  the  user  can  select  one 
or  more  of  the  image  fragments,  expand  the  size  of  the  window  to 
obtain  more  image  context,  mave  a window  for  side-by-side 
comparison,  zoom  in  for  more  detail,  or  adjust  die  center  of  the  window. 


Concept:  ’george  mason  bridge* 

Concept  id:  ’CONCrPT22’  1 roles  (principle  role:  0) 

[0]  george  mason  bridge 

Role  10:  * 8RDG4 ' Role  Defn  ID:  ” 

Role  name:  'bridge'  subrole:  ’automobile’ 

Role  class:  'transportation*  type:  'physical’ 

Role  deriv:  ’ 1 andmark -desc r i pt ion  ’ mark;  ’unknown’ 

3D  Role  ID:  ’D31D14’  3D  Role  pointer  00 
latitude  38  52  43  300 
longitude  77  2 22  690 
elevation  12  meters 

1 140.1482  in  /v i sf /washdc/asc/dc 1 4 1 9/ 1 bw  . img 
landmark  image  at  resolution  1 

george  mason  bridge 

Definition:  A bridge  spanning  the  Potomac  River  in  southwest  DC. 

Located  adjacent  to  the  Jefferson  Memorial  and  the  Rochambeau  Bridge. 

Description.  The  Oorge  Mason  Bridge,  also  known  as  one  of  the 
twin  14th  St.  Bridges,  carries  the  westbound  lanes  of  U.S.  1 
across  the  Potomac  from  14th  St.  on  the  east  bank  to  the  Jefferson 
Davis  Highway  on  the  west.  The  landmark  inage  is  oriented  with 
north  at  the  top. 


Figure  10:  Role  Schema:  George  Mason  Bridge 


5.3.  Multiple  Role  Concept 

The  concept  'national  airport'  is  an  example  of  a more  complex 
organization  of  rote  schema.  Figure  11  shows  the  current  concept 
description  for  'national  airport'.  The  principle  role  AIRP1  defines  this 
concept  to  be  a commercial  airport,  whose  boundary  should  be 
interpreted  as  a aggrcgratc-physical  feature,  that  is  a collection  of 
physically  realizable  boundary  descriptions.  Within  the  context  of  the 
area  represented  in  'D3ID59'  will  be  found  all  roles  which  comprise  this 
concept. 

The  other  roles  define  the  airport  terminal  building,  a runway,  a id  a 
collection  of  hangars.  The  terminal  building  'BULD17'  and  the 
airplane  hangar  'AIRP4'  have  boundary  descriptions  associated  with 
them,  while  the  runway  'AIRP3'  role  has  none.  Geometric  queries  on 
the  concept  map  database  would  find  the  terminal  building  and  hangar 
as  contained  within  the  principle  role  of  the  concept  'CONCHPI'55', 
"national  airport".  However,  a symholic  query  asking  for  all  the  roles 
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Figure  9:  Database  Retrieval  of  Multiple  Views 
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associated  with  the  principal  role  lor  concept  CONCIPI55'  would 
find  tire  runway  as  well  at  the  other  two  roles.  The  relative  merits  and 
limitations  of  strict  user  defined  symbolic  representation  vs.  using 
geometric  queries  to  build  plausible  symbolic  relationships  is  an  area 
for  future  research. 

We  have  begun  to  create  detailed  models  for  airports  and  industrial 
area  roles,  initially  as  a guide  to  the  interactive  user,  but  expect  to 
integrate  such  static  descriptions  into  an  active  query  component  in  the 
future.  We  arc  calling  such  descriptions  site  description  models. 
Currently,  users  are  free  to  describe  as  role  schema  those  portions  of  the 
airport  description  model  that  arc  of  importance,  without  a requirement 
to  create  a completely  specified  airport  site  description  model.  Figure 
12  details  a preliminary  organization  of  an  airport  description  model. 


We  see  this  work  as  a natural  development  towards  including  in  the 
concept  map  representation  cxplicitc  modeling  of  physical  relationships 
between  site  structures,  functional  descriptions  of  structures,  and 
functional  relationships  (processes)  between  collections  of  model 
structures. 


6.  Map  Query 

There  arc  four  database  access  primitives  which  can  be  employed 
singularly  or  in  combination  to  extract  the  positional,  factual,  or 
relational  attributes  required  to  answer  the  queries  posed  in  the 
beginning  of  this  paper, 
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Concept:  'national  airport’ 

Concept  id:  ’CONCCPT55’  4 roles  (principle  role:  D) 

[0]  national  «:rnort 

Role  IP:  ’ A I R P 1 ' Role  Defn  ID:  ’’ 

Role  name:  ’airport'  subrole:  ’commercial’ 

Role  class:  ’transportation’  type:  ’ aggregratt -phys ical ’ 
Role  deriv  ‘hand-segmentation’  mark:  ’unknown’ 

3D  Role  ID:  ’D31D59’  3D  Role  pointer  @0 

[1]  national  airport 

Role  ID:  ’8ULD17’  Role  Defn  ID:  ’’ 

Role  name:  ’airport’  subrole:  ’terminal’ 

Role  class:  ’transportation’  type:  ’physical’ 

Role  deriv:  ' terminal - in terac t ion  ’ mark:  ’unknown’ 

3D  Role  ID:  ’D3ID6D’  3D  Role  pointer  @0 

[2]  national  airport 

Role  ID:  ’AIRP3*  Role  Defn  ID:  ” 

Role  name:  ’airport’  subrole:  ’runway’ 

Role  class:  ’transportation’  t^pe:  ’physical’ 

Role  deriv:  ’hand-segmentation’  mark:  ’unknown’ 

30  Role  ID:  ’’  3D  Role  pointer  £D 

[3]  national  airport 

Role  ID:  ' AIRP4 ’ Role  Defn  ID:  ” 

Role  name*  ’airport’  rubrole:  'hangars* 

Role  class:  ’transportation’  type:  ’physical’ 

Role  deriv.  ’ termina  1 -in  tei  act  ion  ' mark:  'unknown* 

3D  Role  ID:  ’D31D61*  3D  Role  pointer  @0 


Figure  1 1 : Concept  Schema  for  National  Airport 
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Figure  12;  Rule  Definition  Template  lor  AIRPORT  Role 


6.1 .  Signal  Access 

Display  or  list  all  concepts  within  an  interactively  specified  image 
area.  Signal  access  requires  an  cxplicitc  image- to- map  correspondence. 
Image  coordinates  arc  used  to  calculate  tnap  coordinates  which  tire  used 
to  search  the  concept  map  database.  Figure  13  is  a display  frame 
created  by  CONCEPTMAP  as  a result  of  an  interactive  user  query  to 
display  the  area  around  a set  of  storage  tanks  near  the  Washington  D.C. 
navy  yard.  The  query  area  is  superimposed  as  a blue  overlay  in  each  of 
the  display  windows,  the  area  of  interest  is  centered  in  each  window, 
and  displayed  at  the  highest  resolution  that  fits  within  the  window 
partition.  Signal  access  queries  arc  purely  dynamic,  involving  only  the 
BROWSE  window  manager  and  the  image  database  and  do  not  use  the 
concept  map  symbolic  data  structures. 


6.2.  Symbolic  Access 

Display  or  lisi  all  concepts  with  a given  symbolic  name.  Requires 
cxplicitc  mapping  of  a user  defined  name,  ic (memorial  bridge)  into  the 
map  coordinate  system.  As  we  described  in  section  5.1,  the  role  schema 
3D  ID  gives  us  a direct  mechanism  for  searching  ihe  image  database. 

6.3.  Role  Template  Access 

Given  a completely  or  partially  specified  role  schema,  find  all  roles  in 
the  concept  map  database  which  satisfy  the  specification.  The  user  can 
specify  additional  constraints  based  on  the  role  property  template  if  the 
role  name  and  subrole  name  have  been  specified.  ITic  result  of  a 
template  access  is  a list  of  role  schema  ID's.  T hese  may  be  primed  or 
displayed  by  the  user  as  described  above. 
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Figure  1.1:  Sigu.it  Access  Display 


sequencing  uf  access  methods.  mill  CONCI  P I M AP  providing 
automatic  Murage  of  temporary  results  in  die  form  of  qucr> lists  ul  ride 
sehenia  which  satisfi  a prinmnc  query.  1 el  us  .ni.it> /e  llmse  sample 
queries  in  lenns  of  our  query  primitives. 


6,4,  Goomolric  Access 

Using  die  ,11)  role  latitudc/longitude/elevation  ilesenpiion,  eonipme 
geonieiric  properues  sueli  as  containment,  subsumed  b\  intersection, 
adjacency,  and  closes!  point.  A list  id'  u d e sehenia  lIVs  ninth  satisfy  die 
geomeirie  constraints  is  created,  In  the  ease  of  intersection  and 
ailiacenci  a temporary  role  schema  mill  .Hill)  is  generated  nub  the 
results  (point,  line,  polygon)  ol  the  gconietiic  opeiation  for  each  pairol 
database  tide  schema. 


"lion  many  bridges  cross  the  Potomac  Riser  between 
Virginia  and  die  District  of  Columbia." 

( i cl  symbolic  level  from  symbolic  level  null  icinpl.iic  and 
g com,  Inc  constraint 


"Display  images  of  N tiotinl  Airport  before  1476, 
lid  image  from  symbolic  level 


6.5.  Integrating  Access  Methods 

In  order  to  generate  ansners  lot  seieial  of  the  map  database  queries 
posed  at  the  beginning  id'  this  paper,  ne  must  actually  perform 
sequences  of  symbolic,  signal,  template,  and  geometric  access  functions. 
I here  are  clearly  difference  costs  associated  will  each  method, 
geometric  computation  being  the  most  expensne,  symbol  to  signal 
being  the  least  expensne.  We  currently  require  that  the  user  specify  the 


"What  is  die  closest  building  to  dus  geographic 
point”  |/i<oo/  to  screen], 

(id  symbolic  level  from  template,  signal,  aiul  geometric 
constraint 


"Where  is  dus  geographic  point"  ]specij\  geodetic 
coordinate] 

lid  signal  and  synibohe  level  from  signal  constraint 


6.6.  Hierarchical  Query  Resolution 

Consider  die  query  ''where  is  the  intersection  of  .11 ''  and  in  street  ■ 
One  approach  is  to  simply  lind  the  31)  map  descriptions  for  each  of  the 
roles  (symbol  to  signal),  and  perform  a geometric  operation  to  calculate 
a ground  coordinate  position.  I he  concept  map  provides  die  capability 
to  use  symbolic  geometric  relationships  to  generate  the  following 
response: 

<greater  Washington  d.c.> 

(district  of  Columbia) 

(northwest  Washington) 

(georgetown  area) 

(georgetown  business  district) 

(lat  N38  54  18  (374)  Ion  W77  3 41  (213)  el 

When  die  actual  geodetic  location  of  an  intersection  is  required,  a 
geometric  operation  must  be  performed,  unless  it  is  defined  as  a map 
concept.  However  each  of  the  other  responses  resulted  from  a traversal 
of  a containment  tree  which  is  maintained  by  the  concept  map  database. 
'Hie  containment  tree  is  precomputed  from  all  map  concept  features 
having  polygonal  31)11)  descriptions  using  the  geometric  relationships 
of  subsumed  by  and  contains.  Features  having  a dear  hierarchy  of  level 
of  detail  such  at  political  and  cultural  n eighborhood)  cmiro-is  can 
form  the  basis  foi  partitioning  of  other  map  features  to  improve  query 
performance  and  to  better  model  die  spatial  organization  as  more  than 
just  a collection  of  independent  concepts. 

For  this  reason,  we  would  like  to  explore  building  hierarchical 
descriptions  using  the  concept  map  database.  We  can  anticipate  its  use 
as  a knowledge  source  for  more  complex  matching,  for  instance  in 
symbolic  .11. c iic  .v^ogiiiriiib.  Fir  cm: .Tj  le , the  tk cntfuiw  of  colG 
descriptions  for  oil  lank  farm,  power  transformers,  and  cooling  lowers 
within  close  physical  proximity,  indicates  the  area  may  be  power  plant 
or  industrial. 

7.  3D  Map  Display 

\ -evii-duMt  le  1 PjT  x wrirtji  or raiingi  V'ir  tasks  is  flexible  access 
to  31)  map  databases  [6).  Tasks  include  inspection  and  verification  of 
spatial  databases,  incremental  update,  and  feature  enhancement. 
CONCFPTMAP  provides  tools  for  the  selection  of  ground  area  either 
through  image-to-map  correspondence  (ic.  describing  the  area  to  be 
portrayed  via  digital  imagery)  or  direct  specification  of  map 
coordinates.  ’Hie  photograph  in  Figure  14  shows  a fall  frame  window 
containing  a two  dimensional  map  image  of  an  area  around  Washington 
1).  C..  This  13  color-class  thematic  image3  shows  areas  such  as  forest 
and  :«rk  hjeen water  (blue),  residential  (yellow),  and  high  density 
urban  (brown).  It  was  generated  by  scan  conversion  of  a polygon  map 
database  provided  by  the  Defense  Mapping  Agency  (DLMS  Level  1) 
[11- 


In  this  application,  die  user  indicates  a rectangular  area  of  interest  in 
the  map  image,  specifics  the  center  point  (west  of  National  airport), 
viewing  position  (from  the  southeast),  and  view  angle.  This  is  done  by 
tracking  a cursor  on  the  display  to  minimize  the  amount  of  knowledge 
that  the  user  must  have  of  the  actual  3D  coordinate  system. 

The  photograph  in  Figure  IS  shows  the  result  of  the  31)  map 
generation.  For  each  image  point  in  the  area  specified  by  the  user,  a 
map  coordinate  is  calculated  (latitude,  longitude,  elevation).  A 3D 
surface  description  is  generated  using  the  thematic  color  from  die  map 
image,  and  this  description  is  passed  to  a 31)  shaded  raster  graphics 
display  program  [2],  'Die  resulting  map  image  is  then  displayed  by 
BROWSE. 

Hie  CONCFPTMAP  database  provides  31)  map  feature  descriptions 
for  the  generation  of  cartngraphically  accurate  urban  scenes.  The 
|)1  .MS  scene  as  generated  in  IS  is  used  as  a base  map.  onto  which  we 
project  our  map  database  features.  'Die  photograph  in  Figure  16  shows 
a view  of  the  Foggy  Bottom  area  with  die  observer  looking  towards  die 
MiulViC.isl  from  aUnc  the  tawvjctttoti  of  Vitgins  Avct.uc  ?3r3 
Street.  Buildings  in  die  scene  arc  (from  lefi  to  right)  constitution  hall 
(clipped  to  die  scene  viewport),  interior  department,  civil  service 
commission,  bureau  of  indian  affairs,  federal  reserve  board,  stale 
department  and  national  academy  of  science.  Roads  are  Virginia  avenue 
(bottom  right  to  center  left).  C street  (center  left  to  middle  right),  and 
constitution  avenue  (running  along  the  light/dark  terrain  boundary). 
The  linear  feature  running  between  die  interior  department  and  civil 
service  commission  and  occluded  by  the  line  of  buildings  in  the  rear  ot 
the  scene  is  die  boundary  of  die  map  description  for  foggy  bottom'. 

8.  Conclusions 

We  have  discussed  the  current  tmplcmentadon  of  a large  scale  spadal 
map  database  organized  around  a concept  map  representadon  which 
pTt.*idv5  lwflw7.iwwtf.iesJ  lMCTipti*i  < y natural  and  man- 

made features.  User  defined  views  are  supported  by  allowing  concepts 
to  take  on  muldple  roles,  while  maintaining  a consistent  3 dimensional 
map  coordinate  representadon.  Wc  have  shown  how  tne 
CONCFPTMAP  database  can  be  used  for  flexible  access  into  an  image 
database,  display  of  3D  urban  scenes,  and  for  query  into  spadal 
databases.  Wc  believe  that  diis  work  has  applications  in  a variety  of 
task  domains  where  knowledge  representadon  can  be  viewed  in  terms 
of  3 dimensional  spatial  organizations,  particularly  in  cartography, 
jnd  ecological  modeling. 


Reproduced  in  running  black  and  while. 
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